Solving Optimization Problems with Blackwell Approachability
نویسندگان
چکیده
In this paper, we propose a new algorithm for solving convex-concave saddle-point problems using regret minimization in the repeated game framework. To do so, introduce Conic Blackwell Algorithm + ([Formula: see text]), parameter- and scale-free minimizer general convex compact sets. [Formula: text] is based on approachability attains regret. We show how to efficiently instantiate many decision sets of interest, including simplex, norm balls, ellipsoidal confidence regions simplex. Based text], parameter-free achieving ergodic convergence rate. our simulations, demonstrate wide applicability several standard from optimization operations research literature, matrix games, extensive-form distributionally robust logistic regression, Markov processes. each setting, achieves state-of-the-art numerical performance outperforms classical methods, without need any choice step sizes or other algorithmic parameters. Funding: J. Grand-Clément supported by Agence Nationale de la Recherche [Grant 11-LABX-0047] Hi! Paris. C. Kroer Office Naval Research N00014-22-1-2530] National Science Foundation IIS-2147361].
منابع مشابه
Blackwell Approachability and Minimax Theory
This manuscript investigates the relationship between Blackwell Approachability, a stochastic vector-valued repeated game, and minimax theory, a single-play scalar-valued scenario. First, it is established in a general setting — one not permitting invocation of minimax theory — that Blackwell’s Approachability Theorem (Blackwell [1]) and its generalization due to Hou [6] are still valid. Second...
متن کاملOnline Learning and Blackwell Approachability in Quitting Games
We consider the sequential decision problem known as regret minimization, or more precisely its generalization to the vectorial or multi-criteria setup called Blackwell approachability. We assume that Nature, the decision maker, or both, might have some quitting (or terminating) actions so that the stream of payoffs is constant whenever they are chosen. We call those environments “quitting game...
متن کاملBlackwell Approachability and Low-Regret Learning are Equivalent
We consider the celebrated Blackwell Approachability Theorem for two-player games with vector payoffs. We show that Blackwell’s result is equivalent, via efficient reductions, to the existence of “noregret” algorithms for Online Linear Optimization. Indeed, we show that any algorithm for one such problem can be efficiently converted into an algorithm for the other. We provide a useful applicati...
متن کاملBlackwell Approachability and No-Regret Learning are Equivalent
We consider the celebrated Blackwell Approachability Theorem for two-player games with vector payoffs. Blackwell himself previously showed that the theorem implies the existence of a “noregret” algorithm for a simple online learning problem. We show that this relationship is in fact much stronger, that Blackwell’s result is equivalent to, in a very strong sense, the problem of regret minimizati...
متن کاملSolving Optimization Problems with DLL
Propositional satisfiability (SAT) is a success story in Computer Science and Artificial Intelligence: SAT solvers are currently used to solve problems in many different application domains, including planning and formal verification. The main reason for this success is that modern SAT solvers can successfully deal with problems having millions of variables. All these solvers are based on the D...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics of Operations Research
سال: 2023
ISSN: ['0364-765X', '1526-5471']
DOI: https://doi.org/10.1287/moor.2023.1376